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Abstract 

We extend the classical Mercer theorem to reproducing kernel 
Hilbert spaces whose elements are functions from a measurable space 
Xinto C". Given a finite measure on X, we represent the reproduc- 
ing kernel K as convergent series in terms of the eigenfunctions of a 
suitable compact operator depending on K and /.t. Our result holds 
under the mild assumption that K is measurable and the associated 
Hilbert space is separable. Furthermore, we show that X has a natu- 
ral second countable topology with respect to which the eigenfunctions 
are continuous and the series representing K uniformly converges to 
K on any compact subsets of X x X, provided that the support of fi 
is X. 
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1 Introduction 

Reproducing kernel Hilbert spaces (RKHSs) are spaces of functions defined 
on an arbitrary set X and taking values into a normed vector space Y with 
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the property that the evaluation operator at each point is continuous. Usu- 
ally the output space Y is simply F = M or C, but recently the vector-valued 
setting is becoming increasingly popular, especially in machine learning be- 
cause of its generality and its good experimental performance in a variety of 
different domains [H [21 13] . The mathematical theory for vector- valued RKHS 
has been completely worked out in the seminal paper [1], which studies the 
Hilbert spaces that are continuously embedded into a locally convex topo- 
logical vector space, see also [5]. If F is itself a Hilbert space, the theory 
can be simplified as shown in [6l [TJ [H |9] . In particular, it remains true that 
the vector valued RKHSs are completely characterized by the corresponding 
reproducing kernel, which now takes value in the space of bounded operators 
on Y. 

The focus of this paper is on Mercer theorem [10]. In the scalar setting, 
it provides a series representation, called Mercer representation, for the re- 
producing kernel K under some suitable hypotheses. In the classical setting, 
X is assumed to be a compact separable metric space and the reproducing 
kernel K to be continuous. Hence, fixed a finite measure fi on X such its 
support is X, the integral operator with kernel i^' is a compact positive 
operator on L^(X, /i) and it admits an orthonormal basis of eigen- 

functions with non- negative eigenvalues {(Tj}ig/ such that each /j with CTj > 
is a continuous function. Mercer theorem states that 

K{x, t) = J2 ^^Mt)M^ Vx, t e X, (1) 

where the series is absolutely and uniformly convergent (see also [H]). In 
the following we refer to ([1]) as a Mercer representation of K. 

The kind of representation for the reproducing kernel plays an special 
role in the applications. For example, since the family {y/oifi : cTj > 0} is an 
orthonormal basis of the corresponding RKHS Hk, it provides a canonical 
feature map which relates the spectral properties of and the structure of 
Hk- This characterization has several consequences in the study of learning 
algorithms, since it allows to prove smoothing properties of kernels and to 
obtain error estimates, see for example [121 113] and references therein. In 
addition, the Mercer representation is an important tool in the theory of 
stochastic processes [TH [15] and for dimensionality reduction methods, such 
as kernel PCA 

However, in many applications, the "classical hypotheses" of Mercer the- 
orem are not satisfied. For this reason, in the recent years there has been an 
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increasing interest in Mercer representations under relaxed assumptions on 
the input space X, on the kernel K and onY. A first group of results concerns 
scalar kernels. For example, [18] dealt with the case of a cx-compact metric 
space X and a continuous kernel satisfying some natural integrability condi- 
tions. When X is an arbitrary measurable space endowed with a probability 
measure, and K is an L^-integrable kernel, resorting to the spectral proper- 
ties of the operator L^, it is possible to obtain a Mercer representation of the 
kernel [19]. The weakness of these results is that the corresponding series 
converges only almost everywhere. More stringent assumptions on the kernel, 
such as boundedness, allow to get convergence in L°°, which is still too weak 
to get a pointwise representation [2U]. The preprint [21] contains the more 
general developments on the subject. In particular, a Mercer representation 
enjoying pointwise absolute convergence is obtained under less restrictive as- 
sumptions on the kernel. More precisely, given a finite Borel measure ii on X 
and assuming the RKHS separable and compactly embedded into L'^{X, /x), a 
Mercer representation almost everywhere pointwise convergent is recovered; 
moreover, it is proved that the convergence is pointwise absolute if and only 
if the embedding of Hk into L'^{X,fi) is injective. Regarding vector valued 
kernels, [8] provides an (integral) Mercer representation under the condition 
that the K is square-integrable and F is a (separable) Hilbert space. 

In our paper we extend Mercer theorem in three aspects by assuming that 

i) the input space X is a measurable space; 

ii) the output space F is a finite dimensional vector space; 

iii) the kernel K is a. measurable function and the corresponding RKHS T-Lk 
is separable. 

Generalizing the ideas in [22l [23] , we show that X has a natural second 
countable topology making K a continuous kernel. Moreover, fixed a fi- 
nite measure /x such that its support is X, we construct another measure u 
such that the integral operator L^, of kernel K is compact on L^(X, i/, C"). 
Hence, by using the singular value decomposition, we prove that the Mer- 
cer representation ([1]) holds true, where {fi}i£i is any orthonormal basis of 
eigenfunctions of L^, {o"j}jg/ the corresponding family of eigenvalues and the 
series converges uniformly on the compact subsets of X x X. If the support 
of /i is a proper subset of X, representation ([1]) still holds true provided that 
x,t & supp /i. Note that the assumption on Y can be relaxed allowing Y to 
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be a separable Hilbert space provided that K{x, x) is a compact operatoi0 
for all X G X. However, for the sake of clarity we state our results only for 
finite dimensional output spaces and, by choosing a basis, we can further 
assume that Y = C"'. 

The paper is organized as it follows. In Section 2 we introduce the nota- 
tion and we recall some basic facts about vector-valued reproducing kernel 
Hilbert spaces. Section E] contains the main results of the paper: given a 
measurable vector valued reproducing kernel K, Theorem 13.21 gives the Mer- 
cer representation of K and Proposition 13.31 studies the relation between 
K and the scalar reproducing kernels associated with the "diagonal blocks" 
of K, see fll2p . The proofs are given in Sections H] and O In the former 
we prove the Mercer theorem for continuous vector-valued kernels defined on 
metric spaces and satisfying a suitable integrability condition. Section [5] is 
devoted to the proof of Theorem 13.11 and Proposition 13. 3[ The appendix 
collects some properties of the associated integral operator. 

2 Preliminaries and notation 

For any integer n > 1, the Euclidean norm and the inner product on are 
denoted by ||-|| and (■, ■). The family {ej}^^i is the canonical basis of and 
M„(C) is the space of complex n x n matrices. For any matrix T G M„(C) 
we let ||T|| = sup{||T?/|| : y G C", \\y\\ < 1} be the operator norm, T* is the 
adjoint and TrT = J2]j=i'^jj ^^e trace. 

Given a set X, J^{X, C") denotes the vector space of functions from X into 
C". When X is endowed with a o"-algebra A and a positive finite measure 
u : A ^ [0, -|-oo), then i/;C") is the Hilbert space of (equivalence 

classes of) i/-square-integrable functions from X into C", with inner product 
(■, ■)2 and norm ||-||2. If X has a topology, C(X, C") is the vector space of 
continuous functions from X to and B{X) is the Borel a-algebra. 

In this paper we focus on reproducing kernel Hilbert spaces whose ele- 
ments are functions from a set X with values in C^. These Hilbert spaces 
are completely characterized by their reproducing kernel, which is a function 
from in X X X to M„(C), and we take the kernel as the primary object. We 
recall the following definition. 



^This assumption implies that L^, is compact, see Proposition 4.8 of [8], so that 
always has a basis of eigenfunctions by Hilbert-Schmidt theorem. 
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Definition 2.1. A map K : X x X M„(C) is called a C"-reproducing 
kernel if 

a) for all x,t G X, K{x,t)* = K{t,x); 

b) for any m > 1, Xi, . . . , e X, yi, . . . , G C 

m 

^{K{xi,Xj)yj,yi) > 0. 

From now on we fix a C"-reproducing kernel K and, for any x G X and 
j = 1, . . . , n, we denote by the function in J^{X, C") given by 

Ki{t) := K{t,x)e,, t e X. 

We recall that K defines a unique RKHS Hk, whose inner product and norm 
of T-Lk are denoted by (■, ■)k and \\-\\k, such that Tix is a vector subspace of 
T{X, C^) and 

KienK, Vx G X, J = l,...,n 

/(x) = ((/, J^^)k, ...,(/, K:)k) , \/xEX,fEnK, (2) 

see Proposition 2.1 of [8]. Furthermore, the following properties hold true 

K{x, t)ij = {Kl KDk, X, t G X j, / = 1, . . . , n (3) 
-Hk = sm{K,y : X G X, y G C"} (4) 
fix) = Kf X G X 

where : C" — t- Hk is the (bounded) operator defined by K^y = ^ l/jK^ 
for all|/= gC^. 

Finally, we recall that Hk can be realized also as a closed subspace of 
some arbitrary Hilbert space by means of a suitable feature map, as shown 
by the next result. 

Proposition 2.2 (Proposition 2.4 [8]). Let H be a Hilbert space and a map 
7 : X "H" . Then the operator W : H J'(X; C") defined by 

{Wu)ix) = {{u,jl),...,{u,^:)), ueH, xeX, (5) 
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is a partial isometry from 1-L onto the reproducing kernel Hilbert space Tix 
with reproducing kernel 

K{x,t)i, = {^l^i), x,teX, l,j = l,...,n. (6) 

Moreover, W*W is the orthogonal projection onto 

ker W-^ = span{7^y \ x e X, ye C"}. 

3 Mercer theorem for measurable kernels 

In this section we present the main result of the paper, namely a Mercer 
representation of a C"-reproducing kernel K under the assumptions that 
X is endowed with a finite measure /i and K is measurable. The distinctive 
feature of our result with respect to already existing generalizations of Mercer 
theorem relies in the construction of an ad hoc topological structure on the 
space X, intrinsically defined by the kernel. Passing through this topology 
and introducing a suitable measure related to fi, we do not assume the space 
Hk to be embedded in yu;C"), and we are nevertheless able to get a 

Mercer representation for the kernel and a strong convergence result on the 
series defining it. In particular, we recover uniform convergence on compact 
subsets with respect to the topology we introduce. 

As in [221 [23] . we note that the reproducing kernel K defines a pseudo- 
metric d on X 

d{x,t)= sup \\K^y-Kty\\K x,t e X, (7) 

lls/ll<i 

which induces a (non-Hausdorff ) topology tk on X. A basis of tk is provided 
by the family of open balls {B{x,r) : x e X,r > 0} where 

B{x,r) = {t e X : d{x,t) <r}. (8) 

Note that the pseudo-metric d can be replaced by the equivalent pseudo- 
metric d'{x, t) = \JY1^=i 11-^^' ~ ^{Wk^ which gives rise to the same topology. 
The following result states some properties of tk- 

Theorem 3.1. Assume that T-Lk is separable. 
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i) The space X endowed with the topology tk is second countable and K is 
continuous; 

ii) If A is a a-algebra on X with respect to which K is measurable, the 
Borel a-algebra B{X) generated by tk is contained in A; 

Hi) If ^ : A ^ [0, +00) is a finite measure, then there exists a unique closed 
set C G X, namely the support of fi, such that fi{C) = and, if C 

is another closed subset with fi{C') = fi{X), then C D C . 

The support of /i is denoted by supp /i and is, by its very definition, the 
smallest closed subset of X having full measure. The assumption that I-Lk 
is separable is essential to prove its existence. 

From now on, we fix a a-algebra A on X and a finite measure /i defined 
on A. We assume that I-Lk is separable and K is measurable, and we regard 
X as a second countable topological space with respect to the topology tk- 
Though K is continuous, this condition does not ensure that the integral op- 
erator with kernel K is bounded on /i, C^). We overcome this problem 
by considering another measure which is equivalent to /x, such that the 
integral operator with kernel K is bounded on z/, C"). Indeed, define 
u : A ^ [Q, +00) as 

Clearly z/ is a positive finite measure, which is equivalent to yU and it satisfies 
suppi/ = supp /i. Furthermore, since 1iK{x,x) < n\\K{x,x)\\, the integral 
Tr K{x^ x)dv{x) is finite and Theorem I6.1l in the appendix states that the 
integral operator with kernel K 

U : L^{X, V- L^[X, V- C") 

{Kf){x)= [ Kix,t)f{t)du{t), (10) 
Jx 

is well-defined, positive and compaclH. The Hilbert-Schmidt theorem gives 
the existence of a basis of L'^{X, u^C"') of eigenfunctions of L^, and this basis 
provides a Mercer decomposition of K, as shown by the following result. 

^If Y is infinite dimensional and K{x,x) is compact for all x E X, it is possible to 
prove that Li, is compact by Proposition 4.8 of [8]. 
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Theorem 3.2. Let {X,A) be a measurable space endowed with a finite mea- 
sure fi. Assume that the reproducing kernel K : X x X ^ M„ (C) is measur- 
able and T-Lk is separable. Define u as in ^ and Ly as in ffTOj) . Then there 
exists a countable family {fi}i^i in J^{X,C"') such that: 

a) for all i & I the function fi is continuous with respect to tk, 

b) the family is an orthonormal basis ofkeiL^ C L^(X, z/;C") and, 
for all i E I , L^fi = aifi for some ai G (0, +00). 

Given any family {/j}iG/ satisfying a) and b), then 

i) for all X, t G supp /i and j, / = 1, . . . , n 

KM, = Y,^,fi{t)fi{x), (11) 

where the convergence is uniform on compact subsets o/supp /i x supp 

ii) the family {y/o^fi}i(zj is orthonormal in I-Lk', 

Hi) if snpp fi = X, {y/d~ifi\i(zi is an orthonormal basis ofT-ix- 

iv) for j = 1, . . . ,n, the family {^/o^fi}ieI is a Parseval frame in the scalar 
reproducing kernel Hilbert space T-Lkj with reproducing kernel Kj given 
by 

Kj{x, t) = K{x, t)jj x,teX. (12) 
We recall that {y^/fjiG/ is a Parseval frame in T-Lrj if 

\\f\\% = T.^^\{f,fi)Kf ^ffe-HK,. (13) 

i&I 

Item|iv]) of Theorem 13.21 provides a tool to construct C"-reproducing kernels 
as shown by the following result. 

Proposition 3.3. Let {X,A) be a measurable space endowed with a finite 
measure /x such that supp = X . Given a family Ki, . . . , Kn of n scalar 
measurable reproducing kernels on X , for each j = 1, . . . ,n take a Parseval 
frame {//}jg/ in the corresponding reproducing kernel Hilbert space Hk with 
I countable, and define the function K : X x X ^ M„(C) as 

K{x,t)i, = Y,n{t)W) Vx,tGX (14) 

The map K is a measurable V,^ -reproducing kernel on X satisfying f[T^ and 
Hk is separable. 
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4 Continuous Mercer theorem on a metric 



space 

The first step in order to show Theorem 13.21 is to prove Mercer theorem under 
the assumption that X is a metric space, K is continuous and Tr K[x, x)dv{x) 
is finite. For scalar kernels the result is well known, see [13]. However, our 
proof is elementary and it holds for vector valued kernels. As in [211 125] , it 
is based on the singular value decomposition of the embedding iy : Hk — >■ 
L'^{X, i>; C""), which is a compact operator. We will make use of some known 
properties of i^, collected in the appendix. 

Theorem 4.1. Let X be a separable metric space and v a finite measure de- 
fined on B{X). Assume K : X ^ X ^ M„(C) to be a continuous reproducing 
kernel such that 

Tr (x, x) dz/(x) < +oo. (15) 

Define the trace class operator Ly as in (fTOl) and take an orthonormal basis 
{fi}i^i of ker Ly"*" of continuous eigenvectors of Ly and let {(Tj}jg/ C (0, +oo) 
he the corresponding family of eigenvalues. Then the family {y/aifi}i£i is 
orthonormal in Hk CLnd 

K{x, t)i, = <y^fi{t)W) Vx, t G supp z/, (16) 

i&I 

where the series converges uniformly on any compact subset of supp v x 
supp I/, //suppz/ = X, {^/o~ifi}i(zi is an orthonormal basis ofUx- 

Remark 4.2. Item 4) of Theorem 16 . 1 1 in the appendix guarantees the existence 
of a basis {fi}i^i of ker L^'^ of continuous eigenvectors of L^. 

Proof. As in Theorem 16. ![ we denote by i^ : Hk ^ L'^{X, z/; C") the canon- 
ical embedding. Its adjoint z* is given by fl25|) . so that = i^il, and we 
define the operator : T-Lk — ^ ^^K as T^, := ili^. Take a family as 
in the statement of the theorem and, for all i & I, define Qi = i^fijyfo'i. 
The singular value decomposition of i* gives that \^gi\i^i is an orthonormal 
basis of ker T,^^ of eigenvectors of Ty. We claim that, for all x E supp u and 
j = 1, . . . , n, Ki G ker T^^. Indeed, for any / G ker T,^ 

n „ 

= {TJJ)k = {^J,^J) = / \P{x)\'M^)- 

3=1 
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Hence, for any j = 1, . . . ,n, the map x h-> /•'(x) = (/, KI)k is zero i/-almost 
everywhere. Since Hk ^ C{X, C"), see item 1) ofTheorem l6.lt the definition 
of support imphes that (/, KI^k = for all x G supp u. Hence 

K^l G kerT^ Vt G supp v, j = 1, . . . , n. (17) 

Furthermore, since {gi}iei is a basis of kerTj;*-, for all x G suppz/ and j = 

1 . . . TT- 

Hence, the reproducing property gives that 

Kix,t)i^ = {kikdk = J2{K^9^)K{9^,Ki)K = ^^^.//(t);^ 

for all x,t E supp z/. 

Concerning the uniform convergence, suppose / = N, fix two compact 
subsets C, C C suppz/, and consider the remainder 



sup 

{x,t)ecxc' 



x] 



i=q 



< 



\ 



+ 00 



SUpE(Ti|//(x)p 



i=q 



\ 



+ 00 



supEa,|//(t)p. (18) 



i=q 



The series of continuous functions ai\f-{x)\'^ converges pointwise to the 
continuous function K{x,x)ii on the compact set C, and therefore uniform 
convergence follows from Dini's theorem. Thus, relying on the bound in (fTSjl . 
we have 



lim sup 

1^+°° {x,t)&CxC' 



X 



i=q 



0. 



Assume that suppz/ = X. Since, by (j4]), {Kl : t G X, j = 1, . . . n} is total 
in I-Lk, (pTjl implies that kerT^ = {0}. Hence the family {i/o7/j}ie/ is an 
orthonormal basis of I-Lk- n 



5 Proofs 

To prove the Mercer representation in the general setting of Theorem 13. 2[ 
we would like to define a metric d on X such that K becomes continuous. 



10 



A natural choice would be the map d defines by ([7]). However, d is not a 
metric unless the map x H- is injective. To overcome this problem, we 
first introduce a suitable metric space X and a continuous kernel K such 
that the corresponding reproducing kernel is isomorphic to T-Lk and, as a 
consequence, we prove Theorem 13.11 Afterwards, the Mercer representation 
of K is deduced by the corresponding representation f lTB]) of K given by 
Theorem 14.11 From now on (X, A) is a measurable space endowed with a 
finite measure yU. and K is a. C^-measurable reproducing kernel such that Hk 
is separable. 

Clearly (i in ([7]) is a pseudo-metric. The symmetry property and the 
triangular inequality directly follow from the definition, while from t) = 
we get Kx = Kti which as noted before in general does not imply x = t. 
However, the reproducing property ([2]) gives f{x) = f{t) for all / G "He-, 
which means that the functions in T-Lk are not able to distinguish the points 
X and t. This suggests to define an equivalence relation ~ on X by setting 

xr^t ^ K, = Kt. (19) 

Denote by X = X the corresponding quotient space and, given [x], [t] G X, 
define the function d{[x], [t]) := d{x,t). Then d is a. distance on X so that 
{X, d) is a metric space. 

We consider the pull-back topology tk induced on X by the canonical 
projection tt : X — )■ X/^, i.e. 

Tk = {7r"^(A) : A open in {X,d)}. 

It is clear that the family of open balls {B{x,r) : x G X, r > 0} is a basis 
for Tk, see ([8]). Now, the proof of Theorem 13.11 is a consequence of the next 
proposition where C{C"','Hk) denotes the space of (bounded) linear operator 
from C" to Hk endowed with the operator norm ||-||„ ^. so that, for example, 

d{x,t) = \\K^ - KtW^j^ = sup \\K^y - Kty\\K- 

llj/ll<i 

Proposition 5.1. The following facts hold: 

i) the map $ : X — )• C{C"','Hk) given by $([a;]) = is an isometry from 
iX,d) into (/:(C",-Ha^),|HL,,); 

ii) the spaces {X,d) and {X,tk) are second countable; 
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in) the a -algebra A contains B{X), the Borel sets generated by Tk; 
iv) given a positive finite measure v on X , there exists supp u. 

Proof. Statement i) follows directly from the definition of the equivalence 
relation ~ and the pseudo-distance d. 

a) Since T-Lk is separable, the space C{C"','Hk) can be identified with 7/^, 
and then it is separable. Therefore, the set $(X) C C(C"','Hk) is separable 
as well, and so is X, since $ is an isometry. Since X is a separable metric 
space, there exists a countable basis {AjjieAf of open subsets of X. Clearly, 
{7r~^(y4j)}jeAr is a countable basis for tk, that is, tk is second countable. 

To show that Hi) holds true, it is enough to prove that each element 
B{x, r) of the basis of tk belongs to A. Towards this end, if for a given x G X 
we prove that the map '■ {X,A) [0, +00), G^iy) = \\Ky — Kx\\^j^ 
is measurable we are done. Since G^ is the composition of the function 
X3y^ Ky-K^^ C{C^,nK), with C{C'',nK) 3 \\A\\^^ e M, and 

the latter is continuous, it is enough to prove that the first one is measurable. 
This follows from separability of Hk and Proposition 3.1 in [8]. 

Finally, to prove iv), define suppz/ as the intersection of all r/^-closed 
subsets C C X with z/(C) = z^(X). Clearly suppz/ is closed, and we prove 
that 1/ (supp I/) = iy{X). Indeed, since tk is second countable, there exists 
a sequence of closed sets {Cj}j^^ such that, for an arbitrary closed set C, 
C = rikCji^ for a suitable subsequence {Cji^}k£N- Hence, 



C closed, / \ jGN 

u{C) = u{X) u{Cj) = u{X) 



lim p{Cj) = z/(X). 

jGN 
u{Cj) = u{X) 

□ 

Note that, since X is a second countable metric space, it is separable. 
We now define a continuous kernel K on the separable metric space (X, d) 
in order to apply Theorem 14. H once that a suitable measure u has been also 
introduced. Set 

^:XxX^£(F), K{[x],[t]) := K{x,t), 
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and denote by "H^ the RKHS associated to K. First of all, note that ([3]) 
and the definition of the equivalence classes in X guarantee that K is well- 
defined. The next proposition aims at clarifying some basic properties of this 
space and most of all the connections between I-Lk and H^^. In particular, 
as it will be made precise later, the two spaces roughly speaking coincide. 

Proposition 5.2. The following facts hold: 

i) K is a continuous kernel and every f ^l-ij^ is a continuous function; 

a) Ti^ is separable; 

Hi) Tij^ and Hk o'^e unitarily equivalent by means of the unitary operator 
W-.-Hj^^-Hk iWf)ix):=fi[x]y, (20) 

iv) given a sequence of functions (/n)neN in such that fn^f& "Hf^ 
uniformly on the compact sets of X , then Wfn — > Wf uniformly on 
the compact sets of X. 

Proof, i) Given Xcto G X we prove that K is continuous in ([xq], [to])- Foi" 
all X, t G X we have 

\\K{[xi[t])-K{[xoum\ < \\K:K,-K:Ka + \\KK,,-K:^Ka 

< ii/ciiK,j|i^* - i^ioiL.K +\\k: - ^:oL,j|A'*oiL 

Since II A'! I L, < \\K*- K*\\^ + II^.JL^ = \\K^ - K.^J\ ^, + ||ir^,,|| ^, 

II XWK.n — II X XQWK^n ' II XQWK.n II •^0\\n,K II -^OWrt-.K' 

the continuity of $ gives the thesis. 

The second part of statement i) follows by the reproducing formula f{x) = 
K*J for all fe Hfi. 

a) Since X and are separable (see Proposition 15. li u). the space T-Lf^ = 
spEn{K[r^]y : x E X,y E C'"} is separable too. 

Hi) We apply Proposition 12.21 taking % = 'Hj^ and -^x = -^"^[i], so that 

iWf){x) = f{\x]) = f{x) 

for all X G X and f eT-Lj^. Since 

^l-ft = K{[xl[t]) = K{x,t), 
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the operator W is a. partial isometry from Tif^ into T-Lk] moreover, / = 
clearly implies / = 0, and so W is injective. 

iv) Let C be a compact subset of {X, tk)- Since by construction tt : X — )■ 
X is continuous with respect to tk-, T^iC) is compact in X and therefore 
\U\x\) - ^ 0. Being by definition W Ux) = U[x]), the 

thesis follows. □ 

In order to apply Theorem 14.11 to the kernel the last ingredient we 
need is a finite measure i) oyi X . If is defined as in ([H]), using the canonical 
projection we can set 

V{A) := iy{7r-\A)) for all Borel set A in (X, d). 

V is well defined since 7r~^(/l) G BiX) being vr continuous, and B[X) C A 
thanks to Proposition 15. li ni). Moreover, we clearly have 

supp /i = supp V = 7r^^(supp u). (21) 

We are now ready to prove our main result. 

Proof of Theorem \3.2[ From the results collected so^ far, we know that K 
is a continuous kernel by Proposition 15.21 and (X, d) is a separable metric 
space (see Proposition 15.11) . which is endowed with a finite measure 9. In 
order to apply Theorem 14. H we need to show that the integrability condition 
(fT5|) is met by K. From the definition of X, K and z/, taking into account 
that -ft'([x], [x]) = K{x,x) for all x E X, and using the change of variables 
[x] = 7i{x), we have 

[_^k{[x],[x])di>{[x]) = I K{x,x)dv{x). 

J X J X 

Therefore X, K and i) satisfy the assumptions of Theorem 14.11 Hence, K 
can be written component-wise as 

K{[x]Mh = Y.aJlmlm) (22) 

where {^/a^fi)i^i is basis of kerL/^^ of eigenvectors of the integral operator 
Ly whose kernel is K. Furthermore {\/aJi)i^i is an orthonormal family of 
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with fi continuous on X. Then /j := W fi is a continuous function on 
X thanks to the definition of tk and W (see (12(1 ). and {y/a-fi)i^i is an 
orthonormal part of 'H/i' by Proposition I5.2[ zzz). Moreover, for all f,gE Hk, 
it holds 

/ f{[x]rg{[x])dH[x]) = [ f{x)g{x)diy{x) 

J X J X 

by definition of i), and thus is an orthonormal family in L'^{X, u; C") 

as well. Note that, {fi} is also a basis of eigenvectors of Li, since {Lyfi){x) = 
{Li^fi){[x]) for all i & I. The definition of W and equation ( |2T1) entail 

for all X, t G supp z/ = supp fi. 

Since the series in (l22l) is uniformly convergent on the compact subsets of 
supp u X supp 9, by Proposition 15 . 21 the latter series is uniformly convergent 
on the compact subsets of supp /i x supp fi. 

The unitary equivalence between T-Lk and (through W) implies that 
{\/aJi)i^i is an orthonormal basis of I-Lk if and only if {y/a^fi)i^j is an 
orthonormal basis of Hj^. Hence item in) is a consequence of Theorem 14.11 
and (|2T]). 

Finally, we prove item[iv]). First of all note that it straightforward to see 
that every Kj given by ( 1T2|) is a scalar kernel on X. Moreover, it satisfies 

K,ix,t) = Y.a,fl{t)ff{x) \/x,teX 
thanks to equation (fTTIl . 

Fix j = 1, . . . ,n and set ■jx = {.\^ifi)m ^ ^^(-^) for all x G X. Since 

{lul.) = Y.^^n{t)fl{x)=K,{x,t), 

the function defined by 

{W=c){x) := (c, 7.) = Yl v^c.;^, c G f{I), 

is a partial isometry onto TIkj by Proposition 12.21 Therefore we have 
ll/lll = 11^711^ = Y^^MfJ^K/ V/ G 7/^^,, 
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i.e. {■\/^f-}i^i is a Parseval frame in Tixy □ 

Proof of Proposition \3.3\ . Fix j = 1, . . . ,n and let {// }jg/ be a Parseval frame 
in "HRj ■ The function K given by (fT^ is a C"-reproducing kernel on X since 

m m n 

^{K{xi,Xr)yr,yi) = ^ ^ K{xi,Xr)pqy^yf 

l,r=lp,q=l 



l.r=l 



T.J2J2yryff'(^r)f!{xi) 

l^r=l p,q=l iGl 

2 



m n 



r=l q=l 



[Xr 



> 



for all Xi, . . . , G X, i/i, . . . , ?/m G C", m > 1. Finally, we have 
K,ix,x) = \\{K,U\] = J2 l//(^)r = Kix,x),, 



for all a; G X, so that Kj{x,t) = K{x,t)jj for all a;,t G X by polarization's 
identity. 

Since all Kj are measurable, so is K. The fact that / is countable implies 
that each Tix. are separable as well as T-Lk- □ 



6 Appendix 

We recall some basic facts about the embedding of a reproducing kernel 
Hilbert space into L'^{X, u, C"). 

Theorem 6.1. Let X be a separable metric space and v a finite measure on 
X . Assume K : X x X ^ M„(C) to be a C"" -reproducing kernel such that it 
is continuous and 

Tr K{x, x) du{x) < +oo. (23) 
The following facts hold true: 

1. every function in T-Lk is continuous and T-Lk is separable; 
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2. the canonical embedding 

i.-.-Hk-^ L^X.v-C") (24) 

is a well defined compact operator. Its adjoint i* : L'^{X, z/; C") — )■ I-Lk 
is given by 

n „ 

a = J2 Kif\x)du{x), (25) 
,=1 Jx 

where the integrals converge in Hk; 

3. the composition i^i^ : L^(X, i^;C") — )■ L^(X, z/;C") is a positive trace 
class operator given by 

{tXf)i^)= [ K{x,t)f{t)d,^{t) = {LJ){x); 
Jx 

4- there exist a family {/ijjg/ of Lk in C(X, C") fl L'^{X,h';C"') and a 
sequence {crjjjg/ in (0, +cxd) such that is an orthonormal basis 

of ker L^^ = RanLy and 

L^fi = crifi Wiel. 

Proof Set M := J^Ti K{x,x) du{x) G M+. 

1. Given / G Tix, by the reproducing property 

f{x) = {{f,Kl)K,...,{f,K:)K). 

Since the j-th component of / coincides with the composition of the inner 
product in Hk with the map x H- K^, which is clearly continuous, it follows 
that Hk ^ C(X, C"). Moreover, since X is separable, there exists a countable 
set dense Xq dense in X. Hence Hk is separable since S = {K^ : x G XQ,j = 
1, . . . , n} is total in Hk- Indeed, take / G S-^, then the reproducing property 
gives that /(x)-' = (/, Ki) = for all x E Xq and j = 1, . . . , n. Since / is 
continuous and Xq dense, it follows that / = 0, so that the claim is proved. 

2. If / G Hk, then the following chain of inequalities holds: 

I \\f{x)rdu{x) <j{K,KlfJ)ldu{x) <j \\f\\lTTK{x,x)du{x) <M\\f\\l 

XX X 

(26) 
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and the last quantity is finite by hypothesis. Thus ix is well-defined and 
bounded. Moreover, if / G L'^{X, u; C"), we get 



{a^9)K={f,9)2= / {f{x),K:g)diy{x) = { KJix)du{x),g)K, 

J X J X 

where the integral Kxf{x)(\v{x) converges in I-Lk by the Holder inequality, 
since 

\KJ{x)\\du{x)< [ {TTK{x,x)y^'\\f{x)\\du{x), 

X J X 

X ^ (TrK(x,x))^^^ e L2(X,i^;C") and / G L2(X,z/;C"). The component- 
wise representation in equation (!25|) follows by (|2]). 

3. The formula for L^, follows immediately using the expression for ob- 
tained in item 1 and the fact that v is the canonical embedding. In order to 
prove that L^, is a Hilbert-Schmidt operator, we prove that in fact is a trace 
class operator. Fix {(pe}em an orthonormal basis of Hk and note that 



TrL^ = Tr(z*z^) = ^ Pi^V5^ll2 = X / 
em ^ j=i 



\HPe{x)\\'^ diy{x) 

X 



Y^Y.^^,,Ki)ldu{x) 

^ j=i em 

„ n 
„ n 



(x, x)jj du{x) 



M. 



Then Ly is compact and being positive by construction, there exist a basis 
of eigenvectors {/jjieN ^ -^^(^5 C") and the associated sequence of positive 
eigenvalues {cTjjigN- If we denote by / the set of indices corresponding to 
strictly positive eigenvalues, we have that {/i}je/ is a basis of kerLj,^ = 
RanL,^. On the other hand, given /j, i G /, if we define gt = ixfi/ ^ ^k, 
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we have that ii^gi G C(X, C") (i.e. it admits a continuous representative) by 
1, and 

{iugi){x) = [Lyf,){x)l^i = ^ifi{x) (27) 

for zz-almost all x G X. Thus, we can assume without loss of generality to 
be continuous for all i G /. 

□ 
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